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This s'cudy describes an ethnoprraphi ^: •r.pproach to the ■ 
evaluation of a Title I Mathenatic i-rojject designed for 
third and fifth grade low-achievinr ^rtudents. The research 
was desia:ne:.i as a series of eight disaggregated single 
case studies of the implementation of the project with, 
the classroom serving as the unit. _ The focus of the 
Study was the development of ethnographic procedures for 
observing and-describing the way programs are implemented 
using resource teachers to help classroom teachers improve 
instructional services for economically disadvantaged 
minority students. An ethnographic model for use by school 
district evaluators in studying program implementation^ was 
developed. 



Classr' joir^thnographic Study of An 
.&r:::iv±jrf.e;3 -Basi.ee 3^^ Mathematics Program 

RecemilT teibtb has t—en a trand away from exclusive reliancce 
■■■m tr^adi±il33n^ social science models in educational evaluation 
because tfey apply to onlivy a small proportion of questions and 
are rairely ^prs-cxicable in the natxaral environment of the public 
schools (Surrvsn, 2978; Gronbach, 1978; Guba, 1978; Stake, 197S; 
House, 1977) • Guba (L97S,, pp. 79-~80) in writing about a pi^acti- 
rioner movsnisnt towards n^uralisxlc inquiry in educational 
evaiuarrioii, has stated a greed '\ . .xo enlarge the arsenal of 
investn.gative srxategxes available fr)r dealing "with emergent 
queHtijsns of interest; to provide an acceptable basis for studyingo 
process, provide an altrernative where it is impossible to meet 
the technical :i:r sxunptions of the experimental approach in tine 
real world.. . Further, naturalistic or qualitative approaches 

^have been' seen a way tc meet the growing demands for evaluations 
that can be ut5'^' ^-^ed in generating recommendations for improving 
program ef fecTrjiv—ness (Alkin, Daillak, White, 1979; Patton, 1978). . 
This preseir:: STriid::^ was an outgrowth of the limitations of the 
control group imrf^ of the current Title I Evaluation and Reporting 
System to proYlf.:d=r sufficient information for decisionmaking 
(Slaughter, 19SGV> 

Naturalistic inquirjj^jts defined by an approach used when the 
researcher designed thfd^ study to fit the sitiaatUon and answer social 
policy 'issues that often cannot be examined by altering the 
situation. Ethnography is a type of naturalist ic inquiry where 
a trained observer attempts to describe a social situation as it 
functions naturally. As stated by^ Fienberg (1977, p. 52), ^'Rather 
than assess the effectiveness of teaching by traditional techniques 
of test scores, administered before and after some' ' treatment , ' the 
ethnographer chooses to investigate how events within the class- 
room and the interactions between teachers and students affect the * 
learning process. This view of the basic inquiry has led 
ethnographers to the tnethod of direct observation (most typically 
nonparticipant observation) for data collection." Ethnographic 
methodology, using trained observers of holistic behaviors of 
students, teachers and others (and patterns of relationships among 
them) in school settings has seemed especially relevant to under- 
standing educational practice. Tikunof f . and others (1975), 
developed procedures for iritegra'^ng shorter term ethnographical 
observations with other types of data to increase our understanding 
of classroom instruction and student learning. Johnson and 
Gardner (1979) , suggested some first steps in developing a 
prototypic model for > training ethnographic assistants, to work 
with research staff to fulfill fieldwork commitments . in conducting 
a classroom^ ethnography of reading instruction. 
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The objective of this study was to conduct an in-depth citiss- 
room implementation study, using ethnographic methods, -of a 
supplemental Title I mathematics project, The focus of the study 
was the development of procedures for observing and "describing the 
Vi^ay programs are implemented using curriculum specialists or 
resource teachers to help teachers in the regular- classroom to 
improve instructional services for economically disadvant ai^ed 
minority students. The ethnographic approach used also addressed 
questions arising in practice and in the research literature about 
the mathematics learning of low achievers in an i-nst ructional 
program using manipulative aids, that are related to the improvement' 
of compensatory education programs. 



The Evaluation of Resource Teacher Proif?rams: 
Related Literature and Research Questions 

Programs employing resource teachers in specialized areas have 
been one way that administrators have attempted to improve class- 
room' curricula and meet the special needs of individual students. 
This is one way that scarce resources can be extended to benefit 
a larger number of students than would be possible through provision 
of teachers giving direct services to children on a daily basis. 
Resource teachers' assistance within the classroom is a "mainstream" 
approach to compensatory education and may have advantages over- 
pullout programs (Glass and Smith, 1977). One such advantaf?e may 
be articulation of the resource teacher's program and the ongoing 
classroom program. Empirical research was needed to affirm or 
disconfirm this speculation. • / 

Unfortunately, the complex organization' required. for resource 
persons to effectively assist teachers in improving the instruction 
of low-achieving students in more than a superficial way remains 
a problem. For instance, Milof sky (1.974, p. 439) described the f ' 
problems of managing school politics in^ supplemental programs and 
the chronic problems of resource teachers in gaining access to 
regular school personnel and priorit^ies . .Harry F. Wolcott , (1977, 
p. 243) in a study which focused on the social organization of an 
educational innovation stated, "Too many researchers have. . .been 
too attentive to innovations and too inattentive to how educators 
organize to cope with them.'" The need for research that takes into 
consideration the process of mutual adaptation of the implementors^ 
of an educational innovation and the users, e.g. teachers and 
students, was pointed out by Fullan and Pomfret (1977). 

There has been a need for observational research studies on 
the "actual implementation of the resource teacher service delivery 
strategy in practice in naturalistic settings* from a user perspec- 
tive. An observational study is particulary appropriate since the 
introduction of resource teachers into the regular classroom implies, 
role changes for classroom teachers, students, and resource teachers. 
Fullan and Pomfret (1977) indicated that a mailij problem of implementing 
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new , curricula is that curriculum change often mears ha-c new role 
relationships are required of persons putt ing the innior-at ion into 
practice. / Research on the use of manipulative ai in te::3iching 
mat&emati.cs has showri that the teacher effect is -vr-: iel:ring 
(Suydam and Higgins , 1977). 

There is no ^way* an aprlori sjsteiri of observa. lc:::lj1 ccxegories 
would validly reflect the interaction of classrocT^ ^e^h-nr , Mathe^ 
matics Specialist and students fo-T understanding .lae -xinp±^enta,tion 
of this "type of program. Even tightly controlled sxurlies of 
teacher effectiveness have found preset categories th: ob5^>7rvational 
instruments were not always appropriate for an e\ri;^:i-t:io: of an 
intervention (Stayrook and Crawford, 1978). 

Naturalistic observation was especially approTDriate to the 
fluid situation of nonresearch-based compensatory educ:arzz:oa projects. 
However, observation is always selective (Spradley and ScCurdy, 
1972) and must necessarily be focused in ethnography i^sei for 
evaluative, purposes-. According to Erickson ( 1977 , p- 62; , *Tocused 
data collection. .required, knowing something about the setting 
one is studying through information gathered ..before entering the.. . 
setting as well as from first hand experience.*' The Jioriori research 
questions guiding focused observations during the stiidy are listed 
below. This list is illustrative only, not exhaustive, since many 
more research questions arose, as expected, during trir^ srudy. One 
of the purposes of qualitative research is to genera:^ hypotheses. 
Examples of questions used in focusing observations \vv:ere as follows: 

1. How do the resource teachers , i : e . , the M^uJienTiHt ics 
Project Specialists , establish rapport witri dlnss- 
room teachers and children? 

2..- What are the opporl^nanit ies and fo^ how lonr^ -re 

classroom teachers able to observe the demc scr^ation . 
lessons in the regular classroom^ context? 

3. Does the classroom teacher make some special arrange- 
ments to provide space, time, different groupings 

of students, and activities for nontarget students 
during • scheduled demonstration lessons? " 

4. How does the focus and content of demonstration 
less.ons vary with type of classroom, composition 

. of target group , cooperation \of classroom teacher , 
etc. , from one site to another? 

'5. What is the percentage of mathematic mariipulacive 

activities to other kinds of mathematics instruction 
in the classroom? Does this change after the demon-, 
stration lessons? . i. 

6. " Are the demonstration lessons coordinated with the 
regular mathematics program received by the target 
children? , - 
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7A'hat kind and what decree oi guidance is given 
to students during the mani^rulat ive phase, by 
Mathematics Project Specialists and by classroom 
teachers? 

Is there evidence of transT^- of concrete manip- 
ulations to symbolic recor±5 during: rhe observation 
period? ^ - 



Design of z:he St:.. " . ; 

This study reports some emergent fi.:::. ings from a series of 
leight disaggregated single case studie;S. c tiie implementation^of 
a supplemental mathematics pro,ject ntrh^ ^ le cXassroom serving as 
a unit. Kennedy (1979) related the iniac;. tance of the single case 
studjA approach "for documenting the ei^ecrr: 3 of 1:reatment and also 
i:he reasons for these effects. Carryfnv. on the study at multiple 
sites shows how the- treatment funct icier., for different recipients, 
&oth strudents and teachers, in differ^mr contexts. 'According to 
Kennedy (1979) generalized statements ^regarding program effects 
:are of limited validity ^because of tke wide variation in treatments, 
intervening influences and' extenuat iTif^ circumstances in implemen- 
tation. Attempts to clearly define :::.ny single program treatment 
and its affect upon achievement is frrther confounded when students 
participate in several programs incluiding the specific program 
ongoing in the rfegular classroom . Statements of program effects 
in. terms of gains scores aggregating student pre-^posttest means 
across classrooms and schools are only meaningful to the extent 
that program implementation is uniform. 

This study, while primarily ethnographic in approach, was . 
conceived as analogous to'an ABA time „series design in psychology , 
•as described by Kratochwill (1978, pp. 41-42), in that, it incorporated 
meas.urement of baseline condition^', measurement during the inter- 
vention phase and measurement after the intervention was v;ithdrawn. 
However the context of this study was very different from the * ' 

typical experimental study in that the ^'intervention'' itself was 
in nee4. of verification. While it was assumed that "during the 
intervention process the dependent va.riables would be improved, i.e.,^ 
student involvement and success on mathematics t asks , "the point of 
the study was to see if there was improvement immediately after 
the 'treatment and to determine the length of time of treatment 
effect.. Further, if., the treatment successfully improved the mathe- 
matics, performance of the target students, there would not be a . 
return baseline condition. According to Kratochwill (1978, p. 42), 
"This mitigates against the logic of the design and would not allow 
investigators to establish experimental control.'' In a naturalistic' 
inquiry of this sort, experimental control is neither attempted nor 
is it necessary. TSe* ethnographic approach was highly appropriate 
since it could be used to provide information about a progr^rm that , 
since implementation did ^not follow a preset plan, could not have 
been evaluated using an experimental model. 
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This section contrasts the preplanned and actual research 
agenda fc:r conducting and writinf^: up ethnographic observartions . 
This- is ccne to assist others in planning ethnographic evaluations. 

Plaxmed Research Agenda . During the first series of demon- 
strations in the fall of 1980, three ethnographic assista^nts will 
observe T±Lree different classrooms for a period of one mciith. 
The principal investigator wi'll observe at least four times in 
each class-room participating in the study. Narrative records of 
the observs^ticns will be typed daily. The typed records will use 
coide names for part icipants observed. ^ ^ 

The observation plan .is as follows : 

1, An etiinographic assistant knowledgeabia about the 
mathematics curriculum will observe the . mathematics 
target students for one week prior. toObhe demon- 
stration lessons. The observer will know who tiie 
target students are and will make narrative records 
on what happens to t^em during the mathematics 
period. This wi^sL include records on^what the 

- teacher is doing. *^ ^ 

2. The observer will watch the rnathematics dernpnstration 
lessons of the ' systematic use of one or more manip- 
ulatlv^e aids, and maKe narrative records of the teaching 
strategy used^ the target student s V responses , 
indications of the regular teacher's observations 
of the lesson and any other -pertinent factors, such 

_ as what the remainder of the class is doing at thi^ 
time. ■ • ■ , . ' ■ • . 

^ 3. The observer will'be in. the clas^oom' for the next 

ten school days following the demonstration lessons. 
''^ Records will be kept of the activities of the teachers 
and target students during the mathematics class and 
"the students' responses to it. 

4. Once a week, or more if necessary, the ethnographic 
aides will meet with the principal investigator to 
discuss the observations and any, problems in carrying 
out the study • 

The above plan will be repeated for a second round of demon- 
stration lessons in three, different classrooms later in the year. 
Later, two more classrooms will be observed. Consultation with 
teachers, Mathematic Project Specialists and district curriculum 
, aldministrators will supplement and enlarge the scope of the study. 

After the initial series of observations are completed, th~^e 
data will be compiled into a preliminary . report . . At this time,, 
procedures for simplifying^ the observation — data collect ion process- 
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will be explored. For instance, a format for reporting data back 
"to the principal investigator after observations, will be developed 
if possible. Then more highly focused observations will be used 
for conducting observations in three: more classrooms at midyear 
and to more classrooms later in tiie spring. One observer will 
return to the first classroom observed to provide a longer view of 
-the treatment effect on' students. 

Actual. Research Agenda ; ThT:5e ethnographic assistants were 
trained in late September and OcliDt sr and scheduled observations 
over a month^s time in three targ^et classrooms and in one other 
classroom where the teacher was t:er.m teaching with the teacher in 
a tai^get classroom. As seen in Table 1 (Appendix A) fewer obser- 
vat ions by either the principal investigator or the ethnographic 
assistants occurred than originaZILir planned. Observations were . 
planned for a maximum of four da73 a week to allow the teacher 
breathing space of one day without observers and school activities 
such as Halloween Parties, >teacheT absences, etc., further- reduced 
the observations. ,We lelt that the number of observations made 
were sufficiently represent at ive G^f classroom activities during 
the observation period. Principml investigator observations were 
reduced due to the time required in the human relations context 
of establishing the study in the schools and coordinating the 
research with actual instances of program implementation. It should 
be noted that after this was accomplished, in the fall, scheduling 
later observations in the rema±ning five reseaxch sites was much 
smoother. .Principal investigator (PI) observ£.±ions served the ^ 
purpose of (1) maintaining conxact with people in the field, j; 
(2) providing opportunities for developing shared perspective and 
dialogue between the PI and ethnographic assistants , and , most 
importantly, (3) prc^yiding direct e3:periences within each research 
site to" the PI which proved indeperisible in developing theories 
, , about implementation an^ .for .further focusing observations. One 
-method oi, focusing the ethnographic assistants observations was 
tor the principal investigator to provide example protocols, developed 
from jabservatidns iii the research site classrooms/ 

. ' . - ' X . V ■ . 

iJarrative reports, also called protocpls , were not typed * 
daily. We found that each hour of observation' reqiiired a minimum 
of three hours writeup time. While ideally each observation should 
be written up before succeeding observations, this was not . alwayg 
possibIe\ A form -was developed (see Appendix B) for handwritten 
protocols. * • 

Wfiile initially we had planned one week ^,of. ob^l^vations; before 
the intervention and two following it, we found it preferable to 
spend two weeks in the classroom before the intervention occurred. 
-This :was necessary to ensure the correct identification of students 
and familiarity with the classroom routine: Learning students names 
and correctly identifying target students was more difficult than 
we had expected . . Tlj is was probably due to the nonparticipant nature 
of the observations. • . 



Primary observations were A^focused upon the classroom setting 
as sociocultural ^unlt , not incjividual target students. Gump 
CIS£'2), from the perspective of /ecologi^a^l psychology, suggested 
trJisr one- needs to observe-.-.tjig^sett ing unit first and stated., 
"■'Qrje^ has to assume a different observ?.t ional stance for settings.** 
Z m-i — -r v at ions of settings are more difficult to focus because of 
"fch:^ TJTide choice of co-occuring events or episodes, especially 
in HKilti-task, small group ^ organized classrooms. However, since 
classroom episodes last longer, e.g. 20 to 30 minutes, or more, 
ttnan individual behavior patterns, observers can often collect 
d^ita on both settings and individual behavior (Gump 1980; 1974). 
rt is ^specially important to observe settings over time and to 
extend observations through collaboration with classroom, teachers. 

According to Gump (1980, p. 14), information about settings 
is indispensible in studying implementation: / 

A description of a setting, independent of subjects' 
behavior is required. The systematic observatior^/ and 
the quantitative description of settings, as opp9sed 
to individual behavior , would seem to be a useful, ' ^ 
even necessary skill. . . Many of the inte^rvent'ions 
to be evaluated involve settings; Classrooms , .bff ice , 
St aff -development workshops, teachers meetings^ play- 
grounds. and so,on. ^Problems to be solved oft^n appear 
in such settings; interventions are often applied in 
such sett ings., impacts of such /interventions'' need to 
be examined in such settings. For some problems, the 
impact pf intervention creates setting changes which 
then, change indivi^dual behavior^ and experience. In 
f act ,^ without a sturdy and comprehensive setting 
chaftge, many inteWentions will be impotent . 

Our perspective throughout the data collection phase of the 
study has bfeen to pay attention to the classroom unit while moving 
from group to group, especially those containing target ^^children^' 
or. being instructed by TiKLe I mathematics resource , specialists , 
to collect data on interaction among persons and responses of 
individual students. • Methodological suggestions regarding 
improving the focus of observations and of p:^tocols are ^ found in 
a later section. We found that the dynamics of^ the interface 
between classroom teacher and mathematics resource personnel with 
negotiation of the specific form ^and contei^t of the Title I mathe- 
matics services taking placp during, as well as preylous to 
intervention, obviated the possibility of using any preset or 
quantitative approach to observation.. To have attempted to use a. 
less ethnographic approach would have been. to. ignore the ^richness 
of the data and would not have been 'practicable . 

i , A training program, for " the ethnographic assistants was planned 
and implemented with the assistance of consultants Dr. David Berliner 
educational psychologist, and Dr. John. Chilcbtt , educational 
anthropolcgistr The mathematics resource teacher's were also invited 



to . participate iir the training sessions. • Topics discussed during 
training are found in Appendix C. The selection and training of 
ethnographic assistants is summarized in the model 'found at the 
end of this paper. The attempt to promote the:; development of a 
distinctly "ethnographic** approach to studying .classroom imple- 
mentation and trainee responses to it is described below by 
Chilcott. ^ ^ 



Training- of Classroom Ethnographers: 
An Educational Anthropologist 's Perspective 

It is no easy, task to move «a group of people;^ each with his/ 
her own cultural experience and professional perspective, in a few 
short days toward an entirely new professional perspective or world 
view.- It has been my experience that it takes anthropology students 
who are daily immersed in coursework. several yearo to acquire what 
is commonly referred to as the "anthropological perspective."* 

Although reading several essays on the topic (Kimball, 1963), . 
(lanni, 1970) may prove useful to the trainees, it is importaat to 
keep in mind that a classroom ethnographer is severly limited in 
what .he/she may accomplish. It became as'^mti-ch a task of the 
training sessions to make the trainees aware of these limitations 
so as to reduce their frustrations as to convince them of the value 
of anthropological research, • . 

One purpose of the training ses^^ions was to move' the trainees 
from the world view of thei*r particular prof essional of social 
science training to the world view of anthrqplology , "T*his in of 
itself was a cultiiral change process since these individuals felt 
secure in and convinced that their training was superior to other 
social sciences, 

rt was also a task to provide the rationale for ethnographic 
research, .a type of research m'ethodology which is unique among the 
social sciences, and 'the goals of ethnographic method, The non- 
judgmental character of the ethnographic method and anthropological 
insights was particularly difficult to- communicate since the ethic 
of professional education is to make judgements of good and bad 
pedological ibethods; and since the purpose of the ethnography was 
to serve as an evaluation- of a partic^ilar curricular activity, 

A series of lectures and reading materials were provided to 
i^liustrate the goals of anthropology and the use of ethnographic 
method in. acquiring cultural data, A few examples. of ethnographies 
in \onw6st em settings were provided (Geertz , - 1973) with particular 
Emphasis upon method and results in" order for the trainees to 
arriv^N^at an understanding of what the term "thick descriptions" 
connotes-, ' * .^ ' 

^ B6th ^the emic and etic methods were explained and illustrated 
using exampi^ c^from the research conducted by this researcher 
(Chilcol^) in educational settings , A discussion of the 



use of informants to. gather additional information about observed 
events in the classroom followed . A practice^ session involving 
observation and-the use of informants was provided through attending 
an inservice training session for teachers.- These observations 
and information from informants were>compared and analyzed in 
terms of what information was being missed aijd causes f.br the 
differential data among the trainees. 

Other practice sessions inoluded a taped TV -sequence of a . 
third grade classroom in which the trainees again wrote out their . 
descriptions, compared them,' and discussed what * cultural data they- 
had not seen and what cultui^al data was missing- from the TV - 
sequence. At this time the concept and procedures for event . 
analysis, and the sequencing of events wasf in.trodifced'. It also ^ 
became apparent during the exercise of the' l:,mi,tati ons of using 
TV data in classroom ethnography . and of the need of the observer 
to'utilize the holistic approach in understanding the cultural ' . ^ 
determinents .of the sequencing process. , - . ; - * - 

A sample of protocols used in previously conducted clSssrcom.. ^ 
ethnographies were reviewed hot ing 'their al^dvantages and^ disadvantages . 
In order to- overcome their deficiencies:, the trainees were . - 

encouraged to use classroom pr.otocols solely^ as a mnemonic device 
for later- analysis and the writing ot "thi^k". d^e^criptions of the 
classroom observation. It was estimated that the classroom 
observers in order to become classroom, ethnographers woilld ba • 
required to spend three to four hours of p^st observation analysis^ 
in order to complete the "^^^hnographic description; of a one .hour 
observation: : ^ , ^ - J ' 

■ It was at' this point that jthe. trainees frustration level 
reached its apex. They became simply overwhelmed- at the. task 
both as to, its tinie * frame and their ability to cope with a large 
amount of cultural data.. It was necessary to reassure then that 
with additional experience in the' day to 'day reality of classroom 
ethnography, their skills in data collection and analysis would 
improve immeasurably and their task would not be as overwhelming. 
A comparison with a ^corresponding' time sequence of an ethnographer 
in the field who could. easily be. overwhelmed with the language, 
data, and strangeness, of a forei^ /culture during the first few 

weeks in a village, or camp, was useful at t)iis time. 

'> . ■ • .' ■ ■ 

The non judgemental feature of ethnographic research required 
constant reinforcement during the entire period of training. 
, The trainees were constantly being reminded through specific - 
illustrations drawn from their observations of the "cultural . 
baggage*>nvhich they were carrying which was biasing their 
observations. This was particularly apparent in their making, 
judgements as to what*^ constituted good and bad teaching. ^ The . 
acquired skill in making objective observations- required a longer 
period of resocialization thanhad been anticipated by the trainees./" 
Again a comparison with cross cultural ethnographic descriptions ^ 
was a useful device in acquiring an objective viewpoint. 
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There was also a discussi(3n of innovation and cultural 
. change process both in terms of innovation in education and of 
J? cultural chiinge within educational institutii^ns with particular 
^'reference to both the new curriculum which they were observin9: 
and to ethnographic research as innovative in educational research. 

It became, obvious after a few; training sessions, that it 
'V;ould be necessary to constantly reinforce the early training 
tKrpugliout the entire classroom ethnographic observations in 
order to make' constant revisions of the approach and to improve 
* the ethnographic skills of the observers. Similar to novice 
, anthropological field workers, the- best and richest ethnographic 
^descriptions would appear near the conclusion of the study. 
Alternatives in the style and form of writing protocols developed 
o\ver the course of the study described below was one attempt 
tQ improve the quality of the. dafa. \ , 



, \ Writing Pi^otocQls : Alternatives in Style 
, • \ and Form for Classroom Ethnography 

' As iioted, /in the initial training of the ethnographers, 
' examples of piptocols from previous . classroom. observational studies, 
were used as models. , The sources of the models were Cassell ( 1978) , 
Evertson*' (1980t) and. Tikunoff ,; Berliner and Rist (BTES, 1975). 
While tijQ models were useful , in the development of a methodology 
for producing protocols to serve as a, . .rst draft of an observation, 
there wer^ >several problems associated with their use in this • 
form for . school, district evaluative research. Admittedly, the 
detailed record o^ ongoing events was essential to the study,, but 
• the exclusive attention to detail resulted in protocols that were . 
laborious to, write' and not easy to read. To be perfect ly^ caridid , . 
they- were boring and required an enormous , effort on the principal 
investigator Ife part in using them as a,,basis for analysis. There-. 
^ fore, we began reexamining the protocols to find ways, of improving 
their readability within the parameters of our research goals of 
(1.) producing documents that would contain rich descriptions of 
classroom life, (2) maintaining an , impart ial . non judgmental stance , 
(3) providing data, which wou\d be a source of our interpretations 
regarding factors reXated to program implementation (the learning 
of low-achieving .students, etc.) and (4) providing a database that 
could be use(fc'by thW principal investigator within the relatively / 
^short timeframe of evaluative research and the one-year NIE grant . 

In modifying the protocols wq looked at two somewhat inter- 
. related aspects of a protocol. There were (1) format, style and 
the ethnographer's present^ation of self within the protocol and 
(2) a need for a nomenclature for conceptualizing and describing 
phenomenon observed in the classroom. ^ 

Format , Style and the Ethnographer ' s Presentation of Self .. 

Research is generally written in the past tense and mention • 
of the riesearcher, if at all, is in the^ third person . Schollon ' 
and Scollon (to appear, 1981) would term this^ as the Western ; 

ERfc 13 
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essayist style which is highly docontextualized , and ''the author 
as person by a process of writing and editing seeks to achieve 
a state of self-effacement.** The standard research report is an 
expiaple of essayist literacy as defined by Scollon and Scollon 
( in press) : 

T he ideal text is closed to alternative 
interpretation . It is nonindeKXcal . . Nothing 
outside the text is needed for interpretation , ' 
These factors have important implications . 
A,^,. for the discourse structure. The^ important I 
" ■ " relationships to be signaled are, "those between 
sentence and sentence not those between 
speakers nor those between sentence and 
speaker'. As reader :this requires a constant 
monitoring of grammatical and lexical infor- 
mation. In spoken discourse the listener can 
get a good bit of the meaning from^the context. 
In reading essayist prose the clues to inter - 
\ . pretation are in the text itself . ^ 

Students of the social sciences are taught to use the past 
tense, impersonal nouns and the- third person for self-referral 
as a way of *'dist anc.ing'* themselves from the research. Educational 
researchers and evaluators, as well as other social scientists, 
are accustomed to reading research written in. this style. Ethno- - 
graphy also ' is usually published in this form. However, neither ' • 
the protocols used as models nol* the ones we were producing during 
the first stage of the research study were, .in this form. The 
protocols read like eyewitness accounts of processes as .they were 
happening with the ethnographer appearing in the first person, - 
a quasi participant. Even though the protocols were sometimes called 
narratives, they weren't very good narratives according to essayist - 
literacy or "research*' standards. This may have been one reason 
that they were difficult to 'read. Looking backwards^ the protocols 
in the Tikunoff, Berliner and Rist (1975). study were produced at 
•^'irst by the ethnographer tape recording from his notes and luemoi;/ 
the observational material. This was later transcribed by a sec^ u- 
tary into, a typed continuous numbered line" format. Therefore , the . 
method of recording may have produced the, narrative style of these 
protocols. In our study, funded under the NIE small grants program, 
protocols were written out (from notes and memory) by the eti.iio- 
graphers directly on lined paper similar 'to those used in pipvious 
studies. Initially, this was done instead of tape recording oO-'savc 
time and money. However, because our protocols are writt<3n not 
audiotaped, the /ethnographer has an opportunity tp make st/listic 
decisions as a writer regarding the form the narrative will take. 
In other words, the BTES protocols were much more a first draft 
than written protocols necessarily have to be. The process. of 
writing itself incorporates a kind of editing that may not be as 
apparent or the same in audiotaping. / These writeups took approximately 
three hours of writing time for each hour of obiservat ion , Jit issue, - 
^of course, is the desirability of changes in form and the philosophical, 
political and^ theoretical .assumptions and implications ox these 
choices . 
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One of the goals in refining of the protocols is to create 
research documents that can more readily be used in (evaluation. 
This necessitates having the ethnographic assistants produce 
documents that are easily used by some other reader within definite 
time constraints, both for the producer and the user. Furthermore, 
it might be desirable for the protocols to be directly used as case 
documents with teachers and/or administrators in certain instances 
without the requirement of rewriting^ For instance, a relatively 
simple format change from the numbered linear style to one using". 
topic headings and indented paragraphs would improve readability. 

5^. A more important change would be to use the form of a 
transcript such as found in sociolinguist ic research for recording 
segments of interactive discourse as follows , (Protocol 1/28/81, 
Study E, PI, pages 5, 6): 



94 
95 
96 
97 
98 
99 
100 
101 
102 
103 
104. 
105 
106 
107 
108 
109 
110 
111 



After speaking briefly vath an adult female who 
came into the room, the teacher came over to the corner 
group and holding up the prange (10) rod asked Bill, 
"What's another name for this?" Although trying to; 
answer, Bill couldn't respond with the correct answer. 
Then the. teacher started questioning Penny using the 
following: 



T: 
P: 
Ti 
P: 
T: 
P: 
T: 
P: 
T: 
P : 
T-: 



is orange? 
is red? 



What is this? (White rod, 1) 
One 
What 
Ten. 
What 
Two • 

How many reds equal orange? 
Five 

Then what is another name for orange? 
Five-fifths 

Okay ' = 



Mehan's research (1980). done with videotaping provided a rich 
description of classroom interact ion that can be applied in a., 
modified way. to more traditional approaches to classroom ethno- 
graphy such as found in this study. > When observations include 
-this type of data about interactive discourse, including peer 
group discourse , the transcript provides a quick. and easy reading 
of the dialogue, . " " ' . 



The protocols coiild also be improved if th 
written in the past tense , with only. occasional 
tenses, such as the present tense, where it was 
appropriate. This has been a recommendation to 
the tendency still remains to present the data 
eyewitness account. Written narratives found i 
Other descriptive writing^, including ethnograph 
in- the past tense and therefore there are reade 
research protocols would also be ..presented in t 



ey were, generally 

instances of other 
particularly 

the EAs although 
in an unanalytical, 
n literature or 
ies , g.re generally 
r expectations that 
he past tense. 
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The e thnographer's presentation of self is a much more complex 
and potentially controversial issue since the method used may ' 
convey subtle implications about the role of ^ the researcher in 
conducting the research,. 

In selecting a style (and possibly an epistemology ) for his. 
or heir presentation of self, ethnographic observers can choose to: . 

1. Write about her/himself in the third person, e.g. the 
principal investigator, the observer. • . 

2. Write essayist prose where the observer is not referred. 
. 'to at all in the narrative and events are stated in 

r - typical research style of the past tense, = e.g. 

"observations focused upon the aide's group. . . ^ ' 

■ ' . ■" v; - _ ' ^ 

3. Use the inferred first person of eyewitness reporting, 
e.g. , "Arrived to find all children sitting quietly on 
the rug. Ms. T stops talking to children as she raises " ~ 
h^r hand to address me." 

4. Write in the first person, e.g., "I asked Mrs . Franklin 
to point' dut-^ Margaret to me—the only target child I 
had failed; to identify. I had probably overlooked her 
because. . . " ■ \ ^ , /• 

In developing a model for conduct ing=^ ethnographic evaluation 
reisearch i^' the public schools we had made a concerted effort to 
include teachers as collabiorators in . the research, adopting a , 

; philosophy of researcher-teacher partnership similar to Bawden , 
iFlorio and Wanous (1980). While striving to "fit" into the 
classroom scene as unobstrusively as possible and with minimal 
disruption to the ordinary flow of events, we were under n6 
illusion about the change in the scene that our presence could 
produce. Some. mention of self ^ then in the protocols ' would serve 
to illuminate the kind of relationship established between 
researcher and classroom actors and would increase the validity 
of the data for future use-. Further, some use of the first person 

^"I" in the protocols would tend to be more "true" to the assump- 
tions and guiding principals of the ethnographic method rather than 
copying the stylejof nonnaturalistic methods which ^tend to, separate 
the researcher from the researched. . . 

This is not to say that the "I"' cannot sometimes be overused 
or . inappropriate. We had directed the EAs to refrain from making 
value judgements but to record their impressions, concerns or 
opinions in an addendum to the report. We found that while they 
usually avoided the former, they seldom included the latter, In 
the second stage of the study, we made a concerted effort 
to Include more analytical or speculative material at the end of 
each protocol. The issue here is training people to sde and, 
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describe patterns of; events and behavior. In addition, further 
modification in the method of constructing protocols discussed , 
below may increase their usefulness for evaluative research. 

Developing a Nomenclature for Describing Classroom Pr()cess 

This section of the report will discuss a nascent nomenclature 
that could- be used. to describe processes . observed in classrooms - 
which are implementing activities-based programs for developing 
mathematics concepts . This nomenclature may be useful for focusing 
observations as well as in organizing the data for later analysis. 
Since this nomenclature wfll necessarily be a result of our 
experiences as observers in the classropm and can be considered ^ 
one of the end products of the, study, it v/ill only be discussed 
in ah abbreviated form in this present report. 

Some of our ^'naming" refers to interactional variables 'while 
others refer to variables within the mathematics curriculum. Two 
importan't interactional variables defined by Philips (1980) are 
^ The Attention Structure of face-to-face interaction, or the 

~behaA^ior-oJ,_^^^ and students that signals who is paying 

attention to whom,~~^", . and-i! Dlsfiourse Structure , or -the way in. 
which different ' individuals build on the~UtteranGes of other^, : 

* This is important to our study bf the^ role relationships* between 
classroom 'teacher and ^resource teacher in implementation , For . 
example, in s.ome of our ..research classrooms we have observed a 
parallel . team-teaching arrangement where both teacjiers have 
carried out simultaijepus'-teaching activities with small groups of 
students during* the mathematics period with no noticeable paying 
of attention* to the others V lesson . We are also interested in 
noticing the' distribution of talk which occurs (Bateison 1972 .and 
^Mead 1977), e.g. which children, high or low-achievers,, are 
involved most in whole-group or small-group tgacher-directed 
discourse. Which children continually regain the floor? Another 
focus for observation • is the. contrast between -child -discourse, in 
peer;'groups; with and without adults px*esent , We term this peer \ 
group discourse and adult-directed -smallrgroup .discourse , There 
appeared to be qualitative differences between^^jJie way the Math 
Project Specialist (MPS), te.achers and- aides interact verbally 
with students. Some of our observations suggested that MPS 
discourse with students is promoting a more verbal mathematics 
literacy in students' responses to elicit at ions , In other words, 
the MPS will more often ask students to . verbalize a '^number 
sentence'* or '*tell a- Story , ^e . g. two times, five equals -ten , 
while the responses -from children to teacher^ or aides, may 
commonly require- only a one word answer. This type of quali'tative 
difference, if borne out in subsequent observations, would be 
important to the. study of the quality of Title I services received 
by students and also suggests an area where modification in the' 
Title I program njay occur when adopted by nonspecialists . 

A major focus of our study durj^ng the^^ fall was the . observation 
of children playing math games in ;the clas'sroom. Math games were 
demonstrated and played by teachers during the' inservices and were 
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viewed as an important part of the Title I Math Project by both 
teachers' aud the Math Project SpeQialists • One kind of Title I 
service offered by the MPS was to teach games to small groups of 
Title I project participants and this was .frequently given as the 
reason for their being in the classroom. The following list 
includes aspects of classroom game playing that should be included 
in a description: 

1. Pirst turn . When children are in charge of a game 
without an adillt manager , the beginning of ^'conf lict 
or long discussions may be about who goes first, 
second; etc. ^ , 

2. Monitoring the mathematical accuracy of moves . How 
is this done? Can the students monitor each other's 
moves? ■ \ ■ 

3. Consequences of errors . Can the s-^udent practice 
errors in playing- the game? Are there rules and 
penalties imposed when errors are detected by 

' others? . ' 

4. ^' Kinds of errors, accidental or strategic . ^What kinds. 

of mathematical errors . occur? . Is there evidence of 
learning and problem solving during the game? Do some 
children win because of the errors they^ are making?, 

5. ' Group leadership . Is this an" adult dominated group? 

Is there a struggle for dominance by one player? 

6. Learning focus vs. Social, focus . Is the s'tudent's 
concern mainly ^tvith" winning the^game or is s/he . 
intrinsically interested in the math problems posed 

"^^ ; ' by the game? ^ _ 

7. Pacing of game ,; How long does the game last? Does 
it hold the • attention of all players or just that of 
the child playing at the moment? 

8. Distribution of turns; . ' Does everyone get the same 

' number of turns, winners as well as losers? Can the 
game be won in bne turn? 

•^"9. End of game . What happens after the game is finished? 

Do the children play it 'again or turn to other activities? 

In summary, these are .a few examples of aspects of program 
implementation a'hd observables in the classroom that should be 
descjribed in the research protocol. 



Brief Description of the Project 
Being Evaluated 



The Mathematics Pilot Project was in its first year of 
development in 1978-1979. It was the first Title I Elementary 
School project in the district to focus exclusively upon mathe- 
mathics. The goal of -the. project, that of ' increasing student 
understanding of mathematics through effective teaching strateg^ies 
using manipulatable mathematics materials and a process approachv 
to learning; was built axpon the TUvSD Mathematics curriculum 
philosophy. The district had provided a variety of manipulatable 
mathematics materials to every classroom along with initial 
inservice^s during the 1977-78 school year.. The Title I effort 
was directed towap&s optimizing instructionar services for the 
lowest achievers in mathematics in Grade 3 at eight schools and 
Grade 5 at nine other schools. 

The pilot proj.ect. was unique in that it was the only Title I 
project that was experimental in both its conception and its 
research 'design, utilizing a service-delij^ery model that was a ^ 
compromise between, a pullout and g. mainstream program.- The project 
design called for three Mathematics Project Specialists (MPSs) 
to provide mathematics inservices to teachers and to followup the . 
inservice sessions with classroom demonstrations with small groups 
of target students. Approximately six demonstration lessons were t 
provided to each classroom; This role description, was an innovation 
in that the same people providing a series of inservice training 
workshops were also showing teachers how to apply the new methods 
within the regular classroom context. This not only lent credi- 
bility to the inservices from the' viewpoint of the classroom - 
teachers (who were able to see the teaching strategies in actiou) 
but also ensured a greater understanding of the target students 

learning needs on the part of the resource teachers. . . 

f. . ' 

The three mathematics proj'ect specialists formed a tearfi with * 
different strengths'. One project specialist, a former high school 
mathematics teacher, had a master'' s degr6 3 in mathematics and had 
previously worked in the district mathematics staff development 
and adoption activities. Including. aS.teacher with a extensive 
background in mathematics was a key factor in the project, since 
elementary teachers typically do not have a strong mathematics . 
background. Another had been active in th^. district mathematics 
adoption process and had been a Titie 1 program .assist ant . The 
third was an experienced and successful primary grade teacher. 
The same people have sefved in this! job role ^thrpiighout the project. 

Mathematics inservices focusing upon ;the development of. 
mathematics concepts using manipulatives and mathematics educa- 
tional philosophy were given periodically through the school year.. 
Among other things, this educational philosophy focused upon 
building insight and understanding of mathematics and avoiding . 
introducing algorithms, formulas., shortcuts and rote learning 



too early. Manipulatable materials such as cuisenaire rods and 
the Powers of Ten Kit were used to model both language and 
notation for developing mathematics relationships and ideas. 
Strategies were shared which provided increased opportunities, 
for. students to experiment , .find patterns , and understand their 
"own" solution method. The importance of students having systematiq 
experi;enc.es:with . a wide range of problem solving methods , including 
estimation, trail-and-error , and logical pi*ocesses , was stressed. 

The pilot project, evaluated through the Title I control 
group model, resulted in no significant differences between treat-- 
ment and cbntrol ' groups (Slaughter, 1980). One of the weaknesises 
of that evaluation 'design was . the lack of classroom implementation, 
measures, a lack which this present study proposes to correct . 
The project name changed to the Mathematics Resource Project in FYS^ 
Because 'the mathematics inservices . were highly regarded by teachers 
and Title I parents, inservices were extended to all third and 
fifth grade teachers in the Title I schools. in 1979-80 , thereby 
doubling the number bl^teac.hers served. Only teachers in schools 
which had had the pil6t project were eligible for receiving demonr' . 
stration lessons. As the number of inservices had increased, the > 
.4lumb^r of classroom demonstrations decreased to an average of two 
to^the Classroom Demonstration pJ2^ject classrooms. Evaluation of 
the second^ year, project indicated modest gains for a\l groups 
(Slaughter ahd^^Helmick, 1979-80). This study occurred during the 
third yeai^ of prbject^irnplementation . " 



Research Sample ^. 

At the. request of* the 5?itle I Elementary S.chools^Coprdinator 
and Matherfiatics Project:;Specialists ^ teachers were. not asked-to___^ 
volunteer forothe research project until fall 1980. With the . ■ 
exception of one teacher (Study A) who had volunteereH" f or the 
project during a summer workshop^ about- ethnographic approaches 
to observing children 's language"", teachers were/ not approached 
until after the Title I Mathematics Project, vSpecialists .had met 
with them individually to determine whether or not t^e classroom 
teacher would volunteer for clasisroom services from them. Twenty- 
seven teachers out of a possible 73 volunteered for ^ classroom 
services from the Title I Mathematics Prpject Specialists. Of ' 
these, nine teachers (including a Grade 2 teacher who was team- 
teaching with a Grade 3 teacher ).,, were asked to part icipate in the 
ethnographic study. All agreed to ^Participate as teacher 
collaborators. ^ / 

. ■ • ■ «* ' ^ _ 

.Selection of the classrooms and teacher collaborators was 
bajsed upon the following conditions being met. 

*1. Teacher willingness to volunteer for the research 
project as well as for Title I Mathematics Project 
Classroom Services. (Mathematics Project Speclal- 
c ists recommended possible teacher volunteers.) 
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2.- The teacher m\i St be at a Tit' 
Title I students eligible fo 
in'' Grades 3 or '5. The class 
to receive Title I services 
period. 



I school and have 
"hematics services 
.us±. be scheduled 
• A^ the * observation 



. Grade 3 students were eligible for Title I services 
if they were rated as very low in attainment of 
grade level mathematics concepts and scored in 
stanines 1-3 on a pretest; Grade 5 students were 
eligible if they were considered low achievers in 
math by teachers and had scored below the seventeenth 
percentile on a systemwide mathematics test . 

3. Teacher willingness to provide access for observers 
(who would vbe- taking notes) to conduct thp study. 

4. Teacher interest in collaborating' with researchers 
and Titl^ I Mathematics Project Specialists in 
developing a model for studying program implemen- 
tation. ' 

5. Classroom characteristics and/or student charairtreTT^t ics 
.unique and of importance, e.g. cultural factors, SES 
fa,ctors, to understanding, implementation settirigs for 
Title I. For. example: . ^ 

A . Grade levels included in the study ranged from 
Grades 2 to 5 as follows : Two ^rade 3;dla3srooms 

^ two Grade 5 classrooms, two combiriat4?on Grade 4/5' 
classrooms , one combination Grade 2/3 classroom 
ahd one team-teaching arrangement with a Grade 2 
and '3 teacher working in two rooms. " 

B. The- classrooms represented different^.ethnic groups 
•or combinations, and were in different schools. 

Initial • meetings were; held after, school between the PI and 
classroom* teacher collaborators during which the research project 
was explained and teachers gave their informed consent as paiJ-tici-* 
pants. In eliciting teacher volunteers, the following pUrposes of 
the research we're gj,.ven : . ' .: ■ . ' , ■ \ ' 

To develop an alternatives/extension to standardized 
testing for evaluating Title I programs. 

To deepen our understanding of Title i classrooms and 
he^ needs* of children participating ., in Title I. 

3. To Increase understanding of the implementation of 
Tit le^I. pro-ams which mse resource teachers in the 
classroom,, %A this case mathematics resource teachers. ' 
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4v To increase understanding". of the broad range of 

unique classroom contexts in which Title I services 
are offered. 

.5. To provide a framework for evaluator/researcher , 

resource teacher, and classroom teaclier collaboration 
in broadening our understanding of Title I programs 
as they affect classrooms and program participants. 

6. To develop a model" for ^ study-i^g. the implementation of 
educational programs in the classroom. 

Viewing Program Implementation Through the 
Lens of Applied Ethnography: Some Emergent Themes 

There were emergent findings on virtually all of the research . 
questions developed as guides j.or the study and, in addition, new 
dimensions and/or conceptualizations of the program and its imple- 
mentation features became visible as the research progressed. The 
"results'* reported here are neither exhaustive nor comprehensive 
and are very preliminary in that the data collection phase of the 
stiidy has just been completed in March. There is a need for time 
to thoroughly analyze and cross reference the data and to explore 
.the vuse of . triangulation methods for cross-yalidating the findings. 

These prelimiri'ary results are organized around a few themes ^ 
or interpretative trends obs^prved regarding the clas£:room imple- 
mentation of the Title I Matiaematics Resource Project. As such, 
program implement;ation. rathex. than the mathematic content; will 
be the focus of this^brief report; later reports will describe 
some* features of the use of. manipulat ives witl:tjLn ^the classroom 
. for teaching low achievers . Some major themes': 

AMBIGUITY . In talking abput the research project with a 
prpspective teacher/collaborator the teacher suggested that 

'perhaps teachers need xto be inserviced in how' to work with resource- 
teachers. That this statement was made by an ex;perienced class-, 
room teacher who had worked in several feiderally funded schools 
is suggestive of the ambiguity that .surrounds the resource teacher 
role. In the effort to gain en-try into the .classroom^ and to meet 
the needs of students and teachers in a variety of contexts, the 
resource teachers attempted to accommodate their own services to 

"the ongoing situation in the classroom. In doing this there was 
a' tendency' for the resource teacher to wait until after individual, 
consultations with the teacher shortly before going into the 
classroom, or 'even ^ until after the initial day in the . classroom , 
before fully specifying the kind of services that were to be 
brought into the classroom. 

" ; While the intention of the program implementors to accommodate 
to individual differences in classrooms was understandable, some 
unintended outcomes resulted from this amb^iguity. First, teachers 
were often uncertain about what to expect and how to prepai-e or 
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organize the classroom to best utilize the resource teacher skills. 
It is hypothesized that one reason some teachers did not choose 
to participate in the classroom services project was the ambiguity 
about what their participation might entail. Because there wasn^t 
any shared model or series of niodels of how teacher and resource 
teacher should collaborate within the classroom, the actual 
organizational pattern for their collaboration occurred during; the 
time the resource teacher was in the classroom-~a situation that 
could be highly anxiety producing for all concerned , especially 
for a resource teacher not wanting to disrupt ordinary classroom 
procedures. It also . could result in a situation where the intended 
function of the.resource teacher's classroom services, e,^, to 
help the classroom teacher implement an improved Instructional 
program, was undermined. For instance, the.resource teacher role 
could be perceived as similar to that of an aide or of an enrich- 
ment teacher, e.g. as someone providing a special Vtreaf for the 
""students that was not directly related to instruction. This then 
resulted in a situation that either would be renegotiated further 
by the resource, teacher or, in some cases, the role of the resource 
teacher remained ambiguous. 

Offsetting the above mentioned ambiguity were carefully 
planned, well articulated mathematics inservices:! The inservices 
provided an essential part of the communicative process in showing 
teachers how to use manipulative aids in the classroom and also 
suggesting what topics should be covered at a grade level as well 
as strategies for grouping. Most in-classroom units used by _ 
resource teachers were built around topics' covered in the • 
iriservices and teachers generally planned to cover those topics 
when resource teacher assistance became available. In fact, one 
effect 'ojf the classroom services component of the project was to ' 
insure the\teaching of topics or us6 of certain methods within 
' the classroom .that had bie'en focused upon in the inservices. 

CONDITIONAL COfiLABCRATXON . One theme ;6f the study concerns 
the conditions established. by classroom teachers and resource 
teachers in woirjcing together in the same cl^as'sroom. In two of 
our research sites , classroom teachers were "very specif ic in 

• establishing conditions for their partnership with resource " 

tea.chers previous to implementing the activities-based mathematics 
project. In research site H, ;Mrs. H. , the ^^classroom teacher , 
and the school-site Title I project assist ant (who had received 

. . training from the-MPS) worked together all ..fall and in January 
to implement the program.. Mrs, H: said that she accepted the 
offer of assistance from the project assist ant on the basis that 
the project assistant work four days a^v/eek in the classroom, 
that they plan 'together and^ that both classroom teacher/ s and 
resource teacher ' s lessons: be on the sam^ topic except that the 
reisource teacher would use cUisenaire rods more than the teacher. . 

- In research site'F, Mrs! Franklin, the clstssroom teacher, requested 
that Mrs . Jones the resource teachei , provide materials and 
lesson plans that both could use durinp; the week the MPS was in 
•the classroom; during that week the MPiS would work on the topic 
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of fractions with the two . lowest achieving groups while 
Mrs; Franklin followed the same lesson plan with the remainder 
of the class*. Further, Mrs. Franklin requested that the fraction 
unit be restricted to the eights family. In Research site A, 
Mrs. A.., the classroom teacher suggested that the .MPS , ^^Mrs . M. , 
provide^ activities related to a measurement unit, i.e., area- and 
perimeter,, that was being developed in preparation for the classes^ 
outdoor campiiig field trip! When in the classroom , Mrs. A., the . 
teacher rotated all' three groups through the MPS activity. (The 
demands thkt the classroom unit itself placed on the MPS will be 
discussed in the next section .) Teachers also tended to change 
the i'dentif ic.ition of target students, often adding.'.hames .*a-;th^ 
list, after the resource teacher contacted him or her concerning . v 
classroom services. 

. Resource teachers- also imposed limits on their collaboration 
with classroom teachers. One limitation was the limit placed 
upon, each classroom unit regarding the number and length of time 
to be spent in the classroom. Others were that the content of 
services relate directly to a manipulative aid/activities approach 
tb^ mathematics and that groups worked with would be kept small. 
A mbre subtle requirement of r.esource .teacher classroom services 
relate to the efficiency of the management plan for organizing^ 
tasks and social relationship^within a specific classroom. 
Interestingly enough, .in two dif^E^ent classrooms we observed 
the classroom teacher enforcing dis^pline in the resource teacher- 
group. " The resource teacher was perceived as a ^^guest*' in the 
classroom; It is hypothesized th^t ^ if .. these and perhaps other 
conditions are not met, classroom services of resource teachers 
will be infrequent. ^ : . . ' 

■. PREDOMINANCE OF CLASSROOM ORGANIZATION . We found that the ' 
resource teachers generally worked within the instructional 
organization pattern pre-established by the classroom teache,r. 
When children were divided^ into instructional groups for nathe- 
matics, (as recommended by the program) usually the. entire class' 
was 'divided into groups with different activities all related to 
the same concept. Teachers then asked the resource toacher to 
instruct one of the rotating groups while they' and possibly an 
aide took charge of the other groups. This structure was fallowed 
in the two classrooms where teachers appeared' to . be having the . 
•greatest success implementing t'he progra.m. . In classrooms where ; 
the MPS worked only with one^ or tvcp small groups, the teacher was 
usually ' observed conduct ing. whole group instruction with the 
rem., -ling students rather than observing the resource teachers • 
insti action. (This could be partly an observer effect as perhaps 
teachers felx they should be '^teachinf;^' something when observed . ) 
The small group rotational plan gave classroom teachers the \. 
opportunity', to guide students use of manipulative and visual aids 
in learning in an activities approach similar to, thax of the MPS 
rather than to engage in recitation • organiz(?d instruction; \ 
attempting the same activity as the resource teacher .also provided 



a shared basis ""f or .discussion followivng the lesson. In any 
event', it would seem that the organization of the entire class-^ 
room. group, ^ not only that of one achievement leyel , must be 
considered a determinant in how programs will be implemented 
in the classroom? ' \ ' 

TEAM-TEACHING NOT -DEMONSTRATION . The pattern .of resource 
'teacher h,elp within the classroom resembled" team- teachine; more 
closely thari that of specialist demonstrations for practioners 
within the classroom. Classroom teachers and resource teachers 
were observed teaching in different parts of the room, seemingly 
V7ith an unspoken but deliberate effort to'ndt observe the other's 
teaching. in discussion with another group ^bf resource teachers , 
they indicated that most of their in-classroojn teaching fits a „ 
team-teaching model rather than a demonstration model . . As 
mentioned previously in two of the research ^ites therfe was 
almost a complete sharing of materials and lesson plans. In 
study H, the classroom teacher was observed saying the same thing, ' 
almost at the same time, as the resource teacher due to using the 
same lesson plans but both seemed una-ware of each other. 

■ ■ ' . . 

The team-teaching situation is perhaps the best that can be . 
devised, for carrying program^ into the classroom. The' team 
situation allows the ifesource tec^cher to perform as a professional , 
educator in a controlled situation and allows s/he to use methods 
and materials developed in inservices and to be there tp. detect - 
difficulties teachers and/or students may have . in utiTiziiig a 
"program. Then . too, the ma*^ hematics- specialists in our project 
disclaimed the ''specialist'* part of their job title, indicating 
the possible unease school people may have regarding a role that' 
might be considered one of dominance rather than of equalitarian 
collaboration. 

TEACHER EVALUATION OF THE INNOVATION . In several Cf; our / 
case studies we found that the teaqher evaluated student learning 
soon after the unit, using manipulative aids and resource t|9acher 
help, was completed using informal, tests including those. found in 
the textbook. If students performed well on the subsequent tests 
teachers accepted' both the new approach and the results as valid. ^ 
However, if students did poorly on paper and pencil tests, this • 
was taken as an indication of the failure of the method for j 
firoducing improved achievement , .,a failure that , was especia;lly ' *^ 
disappointing because of the time consuming nature of the activitiesr^ 
program. This: use of tests by teachers for ..evaluating the program 
was unexpected, as tests had been deemphasized -in the inservices. 
However, teachers apparently were responding to pressures beyond 
" curriculum- resource circles In the importance they, placed on test 
results..- . ■ * • ' ' . . \ 

Issues S uggested By The Trends in This Study 

One feature* of ethnography is that it provides a databas.e 
.that can be used in multiple levels of analysis to answer a . 
variety of questions some of which may emerge after. the data* 



collection phiase is completed, Unlike^.an ethnographic study 
regarding a distant primitive, culture , "this--study and others 
l'4ke it, may be immediately . relevant to policy decisions and 
therefore can have undeniable implications ^ polit.ically ^ Because 
of this it is especially important. to' stress the limitations of 
the study, e*g. a small self-selected sample, limited time frame, 
only experienced teachers participating, etc. , when describing' 
themes In the data and in addressing questions raised. by the 
study. It is especially important that these resul-^s not be 
taken out of context as a^^jiit-ionai debate develops r.i,bout the 
future of categorical a^^.-d^rograms in education, (of which , 
Title I is the . largest>^.. However ^ in recognition of the 
political con,;^xt in yhich this study may be viewed, an abbreviated 
'Statement regaMiag-^Iie larger political context is given below. 

Our study, as was the program it evaluated , was designed to 
explore further the character of mainst ream:^T^.t le I programs in. 
the classroom.-i. Our .bias has been to support, the intent of main- 
stream programs , i^eV, to improve the educational opportunity of 
low achieving students within the regu^J-ar classroorti, thereby ^ 
offsetting the possible detrimental effects qf pullout programs 
{for a fuller discussion /of mainstream Vs . wjlout , see Gla'ss^ . 
and Smith, 1977). ■ . / . \ 

'■ " • . • ■ ' . • ' ■ 

The results described as themes suggest that in prder* to. 
improve the quality of the instructional pi'ogram, for any ccroup 
^of low achieving Title I students within a classrocm context, 
•'the Title I p^rogfam ^'treatment must , take the structure and 
orgainization of classrooms, into cohsideration ^in all stages of ' 
implementation. Teachers plan t^heir instructional programs for 
entire, classes., in^cluding grouping practices, In order to be 
effective, any mainstream program hats lio be planned within this 
total classroom .group context . This has implications for a 
reinterpretat ion or rriodif icatibn of regulatipns regarding the 
administration of compensatpry education programs. Some critics 
of .m approaches to: Title I have comjDlained that benefits 

-intended only for the very, low achievers identified.^^as Title I 
targe"^ . students will accrue to /nontarget students in a Title I 
class.^ jom program. However, the hontarget students may also be 
below average in achievement . We have found in our study that 
the so-Called target group is a "moving target;". in other words, 
the .;group identified as low achievers in one mathematics area, e.g. ^ 
mult iplicat ion , may-^not be the. same group of children as those 
identified as low achievers in another area later in the year, 
.e.g^' fractions, ^ This has been a well-known problem with any 
rigid categorizirg of students into ability groups, a fact 
disregarded by those responsible for. writing the Tit le! I regulations 
A classroom level program, where classroom teacher, resource 
teacher and" instructional aide %e^m' to improve the instructional 
program may not only be an effective way to improve instructional 
delivery servicies to. low achieveijs, it may also be a step towards 
improving the basic skills of students generally . Bossert (1979, 
p. 94-) suggested that social, relationships resulting from sm.alli 
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group ,^ multi-task instructional organization may have a direct 
and positive influence Upon student achievement. Further, the 
ethos of American education requires equal treatment of everyone 
in the room; it is awkward if not repugnant to provide attractive 
and .challenging services to sorrle children and deny them to others 
within the same classroom as would be required by a strict inter- 
pretation of Title I regulations. It can be argued that in many 
situations- without compensatory assistance to low achievers, 
the most valued classroom attribute, i.e., teacher-student dialogue , 
is allotted disproportionately to higher achievers. If classrooms 
and/or schools were targeted for Title I services rather than 
individuals, the result, might be more effective programs. The 
final section of this paper summarizes some steps to be followed 
in using ethnography^ for evaluative research in school district. 

A Mod el for Conducting Classroom Ethnographic 
Evaluation. Studies By and Withi n School Districts 

This, is an abbreviated account of a suggested research agenda 
for use by school district evaluators in developing and conducting 
classroom ethnographies to be/used for educational program evaluation 
The model is interdisciplinary and is based upon concepts derived 
from anthropology, ecological psychology, teacher effectiveness 
research, sociolinguist ics and tiie educational evaluation literature 
to the extent that they can be applied by a school district evaluator 
who is themself, a participant of the school district community- 
The model, as stated. here, is elucidated by the body of this report 
-and other reports regarding the NIE grant which is funding this 
research. Perhaps the best single reference for conducting ethno- 
graphy in the schools is Cassell (1978) A Fieldwork Manual for ^ 
Studying Desegregated Schools. . ^ 



1, Evaluators Network 

.- . . ' ■ ■ *' " ' ' ■ 

It is strongly recommended that an "'evaluator establish his/her 
credibility within a school district for a year or more ^before 
attempting to implement an ethnographic study. Further,' the 
support of the project coordinator and of central administrative 
curriculum personnel is essential, { 

^ 2 , I nformed Consent^ of Participants 

Classroom ethnography . relies upon^the teacher volunteer; the 
' voluntary context of the research forces* the creation of a 
very special research environment of interdependent actors. 
. " As a part of obtaining informed consent , candidates for 
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participation must be informed of the central r -arposes of the 
research and also of the responsibilities , limitations and 
consequences (if any) of' their participation. As in oral 
history, care must be taken that research reports about the 
^ -study are not harmful to the participants. In our study we 
assiired teachers of confidentiality which follows both the 
ethics of ett^nography and of program evaluation, which clearly 
eschews personnel evaluation '(Standards for Educational 
Evaluation Stuff lebeam et al . , 1978). The principal inves- 
^ tigator and ethnographic assistant met after school to discuss 
and plan the research agenda with each teacher. We found it 
helpf'Ul to send a letter explaining the parameters of the. 
study as a followup (Appendix D). 

3 . Maintaihing Confidentiality 

Cassell (1978, p. 77) noted that because of the continuing ; 
relationships formed between observers and participants at 
the site, heeding strictures regarding confidentiality become 
•increasingly important over time. Ethnographers observe or 
are informed of many kinds of information which otherwise 
would not be known by outsiders. Preserving the - confident iality 
of informants, including children, is crucial to both the 
ethics and validity of th^e study. Decisions regarding' the 
use of some types of ''private" information are not easy and 
judgement may dictate that certain bits of information not be 
included in a study evhh when relevant . Usually, studies of 
thir* type are rich enough without the inclusion of "private" 
dat L/C • 

4 . Ethics , 

The ethical basis for ethnographic research was described in 
the previous siections on informed consent and confidentiality. 
The research site, e.g. public schools, must be kept open for 
future research. There are ethical issues and/or considerations 
also in the way 'observations are conducted ,/>the way reports 
are slanted, review procedures available fo^ teacher collab- 
orators and provision of feedback to teachers. Our concern 
was to not only be as unobstrusive as possible in the classroom 
but to make those being observed as comfortable as we could in 
order to preserve an anxiety free environment. 

In scheduling observations four days a. week or less we attempted 
to be sensitive to a teachers need to not be observed at any 
, ' particular time. We instructed the observers to never write 
down anything while they were in the classroom that would be 
upsetting or embarrassing to the teacher or students. The 
protocols that were written later were to separate-out ethnor- 
. grapher opinions, judgements and. hypothesis from the main 
repprt of ongoing '^:3vents. (We plan to ask teachers to review 
the protocols from their classrooms and the results of the study 
later this year.) Feedback to teachers during the study was 
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not about evaluative judgements but consisted of dialogue 
about ' ongoing events and also some discussion of their 
perspective about an emergent hypothesis concerning some 
process, including their use or modification of the 
innovation. Teachers were treated as collabprators , not 
subjects, in the study. 

5. The Viability of the Program Being Evaluated 

An ethnographic study, because of its expense, human-inter- 
action and involvement, and close scrutiny should' only be 
planned if the program to be' evaluated is viable in at least 
one of the three senses of the word as defined in the Oxford 
American Dictionary, (Ehrlich et al . , 1980): 

1. (of a fetus) i^uf f iciently developed to be able to 
siirvive after birth. 

2. (pf a plant) able to live or grow. 

3. practicable, able to exist successfully, a viable 
plan. . . 

6 . Program Evaluability 

The question of evaluability, or whether a program is specific 
and structured to the point where it can be evaluated is 
complex. However, ethnography can be used in situations where 
other kinds of preset evaluation techniques would be inoperable. 
The answer regarding whether an observational study can be 
rationally implemented in a particular context will depend to 
a certain' degree upon the persistance and facility of the 
evaluator in working with program implementors and recipients, 
and also to a large extent on the attitudes of both towards • 
the possible benefits of the^rogram for students (which again 
suggests the importance of ;{5rog?^aiiiviability )^ Establishing, 
a research observation schedule was^^rt^ easy in the fall phase 
ot cur study, as can possibly be expected in a mainstream 
program, but the high regard of the teachers towards the 
potential benefits ot the Title I mathematics services helped 
us^ to implement the research as well. Teachers were also 
interested in participating because of their support for alter- 
native evaluation strategies, including their encouragement of 
a person from central administration spending time in Classrooms 
and because they were interested in a reflective view of their 
own teaching.- • 

7. Curriculum", Not Interpersonal Relations , ' Emphasis 

, ■ . •»>• 

We feel. that ethnographic evaluations of a curriculum area, 
e.g. a reading program, math program, etc. will find easier 
acceptance be more • practical to carry out (because the obser- 
vations cover one period not the whole day) and will produce 
the most, readily usable results, for use in evaluation studies . 
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Staffing ^ . i 

^he employment of parttime personnel to serve as ethnographic 
assistants to the evaluator proved to be the single most 
important feature of the staff ing; plan . The ethnographic . - 
assistants carried out scheduled systematic observations, 
with a concentration of site observations and regular report 
writing, which could not possibly have been carried out by 
senior evaluation personnel ^ responsible for multiple projects. 
For instance, each hour of observation required approximately 
three hpur^^^ of write-up time. Furthermore , the ethnographic 
assistants (EAs) had the- time to continually maintain and 
renegotiate rapport with persons at school sites. Because 
there were three EAs the study' could be carried out at several 
sites simultaneously. . ' ' " 

Selection criteria for ethnographic assistants included 
(1) background in the social sciences, (2) ability ^to develop 
and maintain good interpersonal . relations , (3) experience in 
teaching and in .the curriculum area studied, and (4) well- 
developed writing skills. 

An ethnographic project is .paper, writing and typing intensive. 
(Adequate secretarial support, for the project is very important. ' 

Consultants from the fields of educational psychology and 
Educational anthropology helped to provide a training program 
for classroom observers in which program implementors were also 
Included. Further, a different and potentially more powerful 
situation for evaluation resulted from discussions of program 
iiiiplementation among the evaluation group (principal investigator 
evaluator, ethnographic assistants and consult ants ) and program 
implementors than normally occurs between a single evaluator and 
a number of program implementors . , ^ 

' \ ■ • ■ 

Training Observers and Implementors ' 



It has been widely recognized that the training of observers for 
natiiralistic studies is crucial to the quality o.f the data, 
as well ''as to the maintenance of rapport with persons in the 
fiel^. The training program also has to be designed appropri- 
ately for the educational level and background of the observers 
^ours all had masters degrees). 



'he training program emphasized the subtleties and factors 
if introducing an innovation into' the classroom (an aspect of 
.>he training program, especially meaningful to the implementors) 
is well as (1) the context, and background of the program ^to be 
3valu4ted, (2) establishing and maintaining rapport. with class- 
room t^eacher collaborators, (3) focal points., for observations 
a^nd (4\y writing protocols . Notebooks containing a sample^ 
from ethnographic studies and writin,^s on methodological issues 
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were provided t8 the observers and implementors and 
discussed, (Teachers., were not included in the training 
in our study because of logistics; teachers were not 
selected for the study until after the training sessions 
which occurred after school opened in the fall.) 

An important aspect of the training was the ethics of ethno- 
graphic research, especially regarding anonymity of participants. 
A coding system was established for use in writing protocols 
to preserve anonymity. A form was devised for hand-written 
narratives similar to that used by Evertson at the University 
of Texas. Examples of protocols given in the Evertson study 
and also by Ray Rist in the BTES were invaluable in providing 
models for the ethnographers to use in writing narratives. 
Later, we developed our own models for writing protocols. 
We also found that actual classroom observations rather than 
videotapes were more useful in training the ethnographers. 

The ethnographic assistants also observed and- were participants 
at the mathematics inservice workshops provided for project 
teachers. This served the dual purposes of document ing intended 
program implementation communicated to teachers and to further 
sharpen observational skills in the area of mathematics. 

A nonjudgemental , distinctly . anthropological approach to 
observing and describing classroom scenes and program imple- 
mentation was maintained throughout the' training sessions and 
'during the study. (This was described in greater detail 
earlier in.thi^ report). We found it relatively easy to train 
the EAs to produce eyewitness level protocols of classroom 
events; -it was relatively more difficult to have them produce 
"thick descriptions" containing hypotheses about patterns or 
relationships in the behaviors observed. Periodic informal 
meetings between the principal investigator and EAs , during 
which classroom and program implementation events were discussedv 
proved invaluable to developing richer insights about the study. 

Setting the Context wi th Program Implementors , Building 
Principals , Tea chers and Students for Conducting An 
Ob s e r V at io nkl Study 

In conducting an ethnographic study of resource service delivery 
to classrooms it is very important to work very closely with 
the project coordinator Tand resource staff. The nonjudgemental, 
descriptive and collaborative framework of the ethnographic 
^approach (vs , . the personnel evaluation ajpproaclh) must be clearly 
articulated. The selection. of teachers as candidates for 
collaboration wi^th researchers should be done in a way that . 
the teachers have a real option-not to volunteer. For this / 
reason we contacted teachers ourselves , (after clearing the 
possibility of a research project with the principal) rather 
than having the principal request that teachers participate. 
We also selected"^ teachers who the resource staff felt comfortable 
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working with and who, were experienced and capable. The 
conditions and limitations of the study Were carefully 
discussed by the observers and teacher before any obser- 
vations occurred. Teachers explained the observers 
presence in the rooiti to students as someone who is 
interested in how children work and sometimes made name 
tags for the children to wear during the first ^^ay or 
two to identifyv students . The observers reported that 
after a^day or two children seemed not to notice the 
presence of the observer, although there was some initial 
interest in the notetaking (one reason to keep notes as 
bland and nonjudgemental as possible). 

In establishing themselves in the field, the observers 
attempted to develop a dialogue between themselves and 
the teachers regarding ongoing classroom events. This 
served to enrich the observations as the teacher became, 
an informasit far the study and also this shared perspec- 
tive gave the teacher some vindication about the content ■ 
and focus of the observations. 

11. Duration of the Study, and Scheduling Observations 
Around Implement at io.n 

One reason that may have accounted for our success in 
obtaining teacher volunteers for the study was that we 
' restrricted the study to 20 observations or- a four to 

five v/eek period, and observations occurred mainly during , 
only one period, the mathematics period. The observation 
schedule of conducting observations before, during and 
after resource teachers were in the classroom was an 
efficient .way to study program implementation. Coordinating 
the research agenda with the resource teachers ialso ' 
provided .insights into the service delivery mechanisms 
of the project. 

12 ; Data Collection 

The protocols cont ained ' ( 1 ) an overview or abstract of the 
focus of that day's observation, (2) detailed descriptiori 
.of classroom organization and instruct ion and students 
involvement and response to instructipn, and (3) comments 
. or insights of 'the observer about the meaning of what had 
transpired. The protocols were written up daily and/or 
weekly and were given to the principal investigator for 
review, comments, and/quest ions . After the study was 
^ completed^ at each site, the ethnographer summarized it 

and plannedv a final interview with the teacher during which 
the program would be discussed and her/his reactions to 
tentative hypotheses. Later in the study, teacher review • 
of protocols and. collaboration in the final case study . 
descriptions is planned. This will not only provide *feed- 
back to teachers but will- assist in validating the. findings* 
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Levels of Data A n alysis: Time Cpnstraints on 
the Analysis of the Data 

It is' a' well-known fact that evaluation research functions 
iri a context of severe time-constraints; conversely, ethno- 
graphy studies „are notoriously time consuming to analyze 
and writ •> up. Therefore it is necessary to plan several 
stages oi analysis, some of which can be ongoing during 
-the course of the' study. It is particularly important to - 
review the protocols as they are produced to determine 
whether data on relationships of emergent interest in the 
study are being collected, and also to generate hypotheses. 
As themes begin to emerge in the data during the study, 
it may be possible to use methods of triangulat ion or 
cross-validation in vp.rious settings to test hypotheses . 
Porter-Gehrie and Crowson ( 1980 ) suggested that early data' 
samples be collected around focal issues and later analysis 
occur about cas^e studies and the meaning of relationships 
aci^oss case studies. In our study we plan to produce 
relatively short case studies of each ^ite using excerpts 
from protocols before, during and after program implement at iQfr^ 
in the classroom followed by a general report organized 
around themes with examples from each case study. The 
ethnographic assistants will help with the preliminary 
analysis. 

Reporting Results 

In preserving anonymity of participants while remaining 
"true to the data" it may be more useful and practical to 
develop the latter, e.g, reports developed around themes 
.with relevant examples from ^different sites, then geographic 
site studies. / This type of report also may be more readable 
and useful to various audiences. 

There, is a need for feedback to participants. . It is suggested 
that collaborating teachers be given an example of a protocol 
before the observation study begins. It may also reduce 
teacher anxiety if teachers have a chance to read one or 
more protocols diiring the observational period. However, 
premature sharing of findings may interfere with the "natural 
course'' of events being observed*. We- plan to ask classroom 
and resource teachers, to reV'iew our findings and the data 
from^ their classroom near the end of the study; we also plan 
to involve them in developing program recommendations, v 

Caveats, Difficulties and Things Not To Do 

From' doing fieldwork to setting up the logistics for. the 
study to final report writing there are a number of pitfalls 
to be avoided; . Space does not allow their enumeration here 
however in planning, this present study several -references 
were extremely useful. Guba (1980) warned that evaluat ipn' ' . ^ 



3 



31 



may be dysfunctional to performance and that anxiety may 
be one of the spinoffs from evaluation • Therefore the 
value and potential utilization of the information to be ' 
gained from a study must be a good trade-off for the 
imbalance that it may cause. Also evaluators must be 
prepared to take steps to alleviate anxietytas much as 
possible that is caused by the study. The elaboration of 
problems encountered in a study by deVoss , Nott and Zimpher 
(1980) ;, especially their warning about not overemphasizing ' 
the legal or potential risk factor in obtaining informed 
consent/ was instinictive f or this study. Also noted in 
'several studies was the need to replace observers during 
the study, something that we had to do in January. We 
fourAd that the already trained observers were helpful in 
training the new member of the staff, * 
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Table 1.. Research Time Line for Sta'ge One of the NIE Classroom Imple- 
mentation-Study, Fall 198p 

Research Site A ; Combination Grade 4/5 ^Classroom, Teacher A, Ethno:iraphic 
Assistant (EA) 3/ (Mathematics period, 10:45- - 12:00) 

Summer 1980. Teacher A volunteered to help in anyv/ay as a participant 
in the project. / 

' ' ' ' //f ■ ■ ■ - 

9/18/80. Conference after school between Teacher A and principal 
investigator to confirm Teacher A*s participation in the study 
and .to further explain the study. 

- ^ ■ // / ■ . ^ 

Week 1 of Study, October 6 . 2 classroom observations (EA) (mathematics 

periods were one .hod- and 15. minutes), 26 students in classroom, of 
which n are in Grade 5,15 in Grade 4. 

/I7-. ■ • ■ 

;10/13/80. Conference after school amonq Teacher A,, principal 
Investigator and/mathematics project assistant to discuss and 
plan Teacher A's participation in the study. 

Week 2 of Study, October 20 ., 3 classroom observations (EA) 1 classroom 
observation/, principal investigator (PI) 1 observation of ma thematic 
inservices; involving Teacher A (PI, EA). 

Week 3 of Stfjdy, October 27 . Title I Mathematics Project Specialists 
in classroom, 3 days. 4 classroom^observations \EA), 1 classroom 
observation (PI). ^ 

Weelg 4 of Study, November 3 . 2 classroom observat'ions^ Monday and 
Tuesday (EA)v 1 observation of classroom group at Camp Cooper, 
foVlowup of mathematics lesson. . 

FUTURE PLANS: Ethnographic interview of Teachei^ A, enthnographic t 
interview of mathematics resource teacher. 



Research Site B ; Two classrooms with team teaching organizational plan , 
Teacher B, Grade 2; Teacher C, Grade^a,' Enthoqraphic 
Assistant (EA) 2 . ^Mathematics period^ 12;15,,- 1 <15) 

10/3/80. Conference with Teacher C regarding research study. Teacher C 
volunteers— short confirmation of Teacher B, volunteer 10/5/80 

Week 1 of Study. October 13 . 2 classroom observations by the 

ethnographic ..assistant (EA), 1 classroom observation by principal 

. investigator (PI) (observations were of both classrooms, there 

were 14 students in Grade 3 and 22 in Grade 2). ^ . , ^ 

Week 2 of Study, October. 30 . 4 classroom 'observations (EA), 1 class- 
room observation (PI). Observation of Mathematics Project 
. Inservice (EA, PI) . 



Table 1. Res'.iarch Time Line for Stage One of the NIE Classroom Imple- 
^ , mentation Study, Fall 1980 (contd.) 



Week 3 ov Study, October 2: 7. 3 classroom observations (EA), 1 class- 
room cbservation (PI). Mathematics Project Specialist spent 2- 
days in Grade 2 classroom, *I day in Grade 3 room. 

Week 4 of Study, November 4 . 2 observations, EA. , 

Woek 5 of Study, November 10 . 1 observation, EA. 

FUTURE PLANS:^ Include an ethnographic interview .of teachers, fall 

1980 and returning to the research site in Winter 1981 
to further observe Title I mathematics resource 
teacher anri followup in ciassroom. 



R esearch Site C ; Combinatir:>n Grade 2/3 classroom. Teacher D, Ethnograbhic 
Assistant (EA)* 2 (Mathematics period 10:45 - 11:30) 

10/8/80: Conference. between. Teacher D and principal observer during 
which research is explained an^ teacher volunteers to co.llaborate 
in the study. . • - 

10/15/80. Conference among Teacher D, PI and ethnographic assistant 
_ to introduce teacher to EA.. 

10/16/80. Initial clecssroom observation by EA. 

Week 1 of Study, October 20 . 2 classroom observations, EA.' 

Week 2 of Study, October 27 . Mathematics resource teacher in classroom' 
during one math period, teacher out for inservice in other program, 
Halloween activities. 2 classroom observations, EA. 

Week 3 of Study, November 3 . 3 classroom observations by ^A, 1 class- 
room observation by PI. ^h hour after school conference about math- 
between teacher and math Project Specialist. 

Week 4 of 3t/dy, November 10 . 2 classroom observations -by EA. 



FUTURE PLANS:- Include ethnographic' interview of classroom teacher. 
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NIE Math Project / 
11/20/80 



Date 
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Ending time_ 
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Observer Code # 



# Students Present 



# Aides Present 



# Parents Present- 

# Others Present 
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" (J" '13/80 



1,0-- 



12. j_ 

13. _ 

14. _ 

15. _: 

16. _ 

17. _ 

18. _. 

19. _ 

20. _ 

21 . _ 

22. _ 

23. _ 

24. _ 
25. 
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Date 



Observer # 
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10. I 

11. 

12. 

13. 



14.._ 

f5:_ 
i6._ 

18. _ 

19. _ 

20. _ 

21 •_ 
22. _ 
23. 
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9/22/80 
Monday 



8:30 « 8:45 



8:45 - 9:30 



9:30 - 10:00 



10:00 - 10:15 
10:15 - 11:30 



Introduction and Getting Acquainted 
(Helen Slaughter) 

Orientation to the Research Study: 
a) Purpose, b) Scope, c) Developing an 
Ethnographic Model for Studying Program 
Implementa^tioh and d) Ethics in Ethno- 
graphic Research 
(Helen Slaughter) 

Orientation to the Title I Mathematics 
Project / 

1) Approach to mathematics education of 
the project 

2) Ways of working with classroom teachers 
(Title I Mathematics Project Specialists) 

Break ^.^ 

Ethnography 
(Jack Chilcott) 

Suggested readings : Bawderi, Robert, 
Susan Florio and Donna Wanout. "Learning 
from Teachers: Lessons about Professional 
Development Drawn from Teacher Participation 

in Research and Evaluation." 

*> ' ^ . 

Carrasco, Robert. "Expanded Awareness of 
Student Performance--A case Study in Applied 
Ethnographic Monitoring in a Bilingual 
Classroom." 

. (Ethics) Appendix 2 "Teaching 

As A Linguistic Process--Mid-Project Report, 
V. Koehler NIE Project an Teaching arid 
Learning." : 

Geertz, Cliford. "Deep Play: Notes on the 
Balinese Cockfight."' The Interpretation^ o f 
Cultures. ^ T 



1 



Note: Training will include dicussions of some of the suqqested readinqs, 
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9/23/80 
Tuesday 



9:15 - 10.15. 



10:15 - 10:30 
11:15 - 12:00 



9/24/80 
Wednesday 



8:30 - 9:30 



10:15 10:30 
10:30 - 11:30' 



9/25/80 
Thursday 



Videotape: Mathematics Demonstration 
tor TUSD Teachers 
(Mary Baretta Lorton) 

Developing Observational ^Strategies 

Focusing/selecting topics to be included 
in Narratives ' - ' 

Notetaking vs. summarizing skilTs 
(David Berliner) 

Break , ' 

^Sociolinguistic framework for studying 
classrooms; social interaction and context 
(Helen Slaughter) 

Suggested readings : Rist, Ray. Ethno- 
graphic Techniques and the Study of the 
Urban School . 



Mehan, Hugh. Learning Lessons; 
Organization in the Classroom. 



Social 



Videotape- of a Third Grade Mathematics 
Classroom Lesson: 

Discussion , 

(David Berliner) 

Development of Behavioral Indicies of 
Implementation 
(David Berliner) 

Break 

Non-Parti ci pant/participant observation 
and informatton gathering--etic and emic 
approaches ' \ 

(Jack Chilcott) 

Suggested readings : Behr, Merlyn J. 
(Case Study of One Child) Teaching 
Experiment: The Effect of Manipulatives 
in 'Second Graders' Learning of Mathematics, 

Smith, Louis. An Evolving Logic of 
Participant Observation. 

Rist, Ray, C. and William J Tikunoff 
Manual : Ethno^graphic Observation in^^the 
Classroom j • - 

No meeting. : Ethnographic Assistants „ 
attend mathematics /workshop for rjrade 3 
teachers 8:30 - 11:^30, Room 302, Roskruge 
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9/29/80 
Monday 



8:30 - 9:30 



9/30/80 
Tuesday 



10/1/80 
Wednesday 



10/6-8/80 
Monday - 
Wednesday 



10/13/80 
Thursday 



9:30 
9:45 



9:45 
11:00 



11:00 - 11:30 



8:30 r 10:00 

10:00 - 10:15 
10:15 - 11:30 



10/21 or 23/90 



Dis^cussion of Ethnographic Assistants 
Impressions of the Study to Date 

Break ■ i 

Classroom Ethnography 

(Jack Chilcott) ^ " 

Entry and Establishina Oneself in the 
Field ' 
(Helen- Slaiighter) 

Suggested readings : Wolcott, Harry> The " 
Elementary School Principal. 

Carew, Jean V. and Sara Lawrence. Lightfoot, 
Beyond Bias : Perspectives on Classrooms. 

No meeting : . Ethnographic Assistants . • 
observe mathematics lessqn in classrooms 
not participating in the s^tudy. 

Discussions of -Ethnographic Assistant's 
Classroom Observations 



Break 

Possible Effects of Introducing an 
vation into the Classrooms . 
(Jack Chilcott) 



Inno- 



' Suggested read inqs- :-^ F.ul Ian,. Michael and 
Pomfrel/; Alan. Research on'Curriculum and 
Instruction Implementation (Excerpt: 
Determinants of Implementation ) Review of 
Educational Research.' Winter 1977. . 

Two days of observation' experience for 
ethnogr'aphic assistants (EA)': Two EAs 
observe in nonparticipating classrooms, 
one observes in a research site classroom. 

Training session with PI and consultants. 
Group reading and discussion of EA protocol 
from previous wee.ks observation. 

PI observes in 2 research site classrooms 
at same time as EA followed by consultation 
discussion of focuses of observation 
discussed in ihe study. 

EA attend Title I mathematics inservi.ces 
with teacher "collaborators. 
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.10/23/80 PI meets'^with EAs to coordinate and 

discuss! the research. 

10/31/80 ' Research meeting, PI, consultant 

Jack. Chi Icott, 1 Title I mathematics,.. 
" . . Resource Teacher and the 3 EAs to 
discuss the classroom observations, 
specifics or services offered by "Title 
resource teachers to Classrooms . 

11/20/80 ' Training in ethnographic interviewing 

techniques.. 
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RO. BOX 40400 



1010 EAST TENTH STREET 



TUCSON, ARIZONA 85717 



January, 1981 



Dear 



Thank you for volunteering to participate as a teacher collaborator in the 
-Classroom Implementation Study of A. Supplemental Mathematics Program, funded 
by the National Institute of Education (NIE) under the Teaching and Learning 
Grant. • • 

We plan to begin our observations of the mathematics program in your classroom 
soon. The observations v/ill occur three or four periods a week for approximately 
four v/eeks. All observations are to be scheduleS at the'teacher's convenience 
and fit into your schedule. We will check with you weekly and daily to schedule 
the observations. Observations may be cancelled whenever inconvenient for the " 
teacher and observations wiri not occur when there is a substitute teacher. 
The maximum number of observations is 20, including four observations which 
I plan to conduct personally. Confidentiality and anonymity is assured for 
all participants. 7 ' 

The observers have all been teachers and have worked in the schools. They have 
been trained iri ethnographic observation techniques and will be a? unobtrusive 
as possible, During their first two we^ks, in you,r classroom they will be . 
fpcusing upon the total environment and also trying to learn the names of 
Title I math project participants, for whom they will have a list. 

We would like to thank you for your willingness to participate in this study by 
paying you at the consensus rate of $11.00 per hour for any extra time you spend 
discussing your program and students with myself and/or the observer either after 
schooj or during break times^ etc. We. have a budgeted\amount of NIE. funds for 
this purpose. We also have two ^days of released time substitute pay whi.ch may 
be us.ed fo; you during the study to facilitate the research (this is optional 
based on your own interests and availabil ity) We hope to use a part of this to 
provide feedback to you regarding the results of research done in your classroom, 
and also to give you. a chance to review and make comments concerning the 
research: , , ^ ' ' 

Thank you agaiij for being a part of our research team'. If there are any 
questions or concerns about the study as we go along please call me at 791-6138. 



Helen B. Slaughter 

Principal Investigator \ • * 

Classroom Implementation Study of 

An Activities-Based Supplemental 

Mathematics Project 



Sincerely, 
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V: Handout for AERA Session 34.36 
Title. I Task Force on Evaluation 



daughter 
Legal and .Research SeVvice^ 
Tucson Unified Schoolf District 
Tucson, Arizona 8571 



Excerpt from (Session 2,5;25): 
Classroom Ethnographic Study of 
Ah Activities-Based Supplemental ^ 
Mathematics Program 

John Chi Icott, Coauthor 
College of Education 
University of Arizona 
Tucson, Arizona 85721 . 



A Mo.(iel for Conducting Classroom Ethnographic 
Evalua-tfion Studies By and^ Within School Districts ■ 

This is an abb)(^viated account of a suggested research agenda 
for use by school distric^^^evaluators, in developing and conducting 
classroom ethnographies to/be used for educational program evaluation, 
The model is interdisciplinary and is based upon concepts derived 
from ^anthropology , ecolcigical psychology , teacher effectiveness 
research, sociolinguistics. and the educational evaluation literature 
to the extent that they cAn be applied by a school district evaluator 
who is, themself , aN^arti^/ipant of the school district community. 
The model, as sta.tedt he^;le , is elucidated by the body of this report 
and other reports regarding the NIE grant which is funding this 
, research. ' Perhaps the best . single reference for conducting ethno- 
graphy in the schools is Cassell (1978) A Fieldwork Manual for ' 
Studying Desegregated Schools. • - 



\ 

2. 



Evaluators Network 

It is strongly recommended that an evaluator- establish his/her 
credibility within a. school district for a year or more before 
attempting to implement an ethnographic study. Further, the^ 
support of the project coordinator and of central administrative 
curriculum ^personnel is essential. 

Informed Consent of Piarticipants ' . ' 

Classroom ethnography relies upon the teacher volunteer; the 
voluntary context of the research forces the creation of a 
very special, research environment of interdependent actors. * 
As a part of obtaining informed consent , candidates for - 
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